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ABSTRACT 

To find out to what extent th© ©valuation methods 
described in the professional literature are actually utilized by 
practicing librarians^ a study was conducted of the collection 
evaluation practices in 111 libraries supporting four-year colleges. 
Three assuiptions vere tested; that collection evaluation in the 
population would be nore heavily v<3ighted toward the quantitative 
techniques; that evaluations would tend to be United in scope rather 
than coiprehensive; that evaluation activity would not be formalized 
by written final reports and recommendations. Data collected froe 
questionnaires supported only the last two assumptions« which led to 
the conclusion that collection evaluation activities were nore 
widespread in the population than had been expected^ but that much of 
such activity was ineffective because of a failure to conceive of 
evaluation as a process. (Author/SK) 
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ABSTHAGT 

The ^tudy daalt with collection evaluation praetiees in 
libraries supporting colleges which emphasise four-year undei^«» 
graduate progi'aras. The purpose of the research was to see whether 
and to what extent the evaluation methods described in the pro- 
fessional literature had actually been used by practiciiig librarians 
in 111 libraries in ten of the western United States* On the basis 
of a search of the literature* a questionnaire wae constructed 
which covered most of the basic evaluation methodSi dividing them 
into quantitative and qualitative techniques. The questionnaire 
was eent to the director© of the libraries in the population^i The 
assumptions tested by the etudy were three: 1) that collection 
evaluation in the population would be more heavily weighted toward 
the quantitative techniques than the qualitative; 2) that evalua- 
tions would tend to be limited in scope rather than comprehensive; 
and 3) that evaluation activity would not be formalized by written 
final reports and recommendations. The data from the questionnaires 
were analyzed with the aide of a computer # Analyoi6 of the data 
supported aseumptiona two and three, but not assumption one. The 
author concluded that collection evaluation aetivitiee were more 
widespread in the population than had been expected » However | 
much of this activity was ineffective because of a failure to con- 
ceive of evaluation aa a proceesi^ 
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INTRODUCTION 

Any human endeavor, of an individual or an organi:sation, 
requires an ©lament of planning if it to moot vdth success • 
Such planning must be based on an appraisal or evaluation of the 
current state or condition of the endeavor. The ••Is'* must bo 
ascertained in order for the "Ought" to be attainable. It is a 
truism that progress requires locating where one is in order 
to move to a more dei^ired position* 

A library is a social organisation the basic purpose of 

which is to provide desired information for a specific community 

or public. That community may be a group of elementary school 

children whose information needs are very broad and general^ or a 

group of research engineers whose information needs are highly 

focused and technical. An overall evaluation of a library ought 

to be based on its relative success or failure in meeting the 

actual and potentiaiL information needs of the community which it 

serves. Of the numerous facets of library practice which relate 

to fulfilling the primary goal of supplying informationi technical 

serviceBi circulation, reference, or administration, for example, 

none is more basic than the development of the collection itself. 

Information cannot be supplied unless the library has it available 

within its "memory bank.^* In academic libraries, the information 

store must reflect and meet the needs of the educational program 

of the sponsoring institution or it has failed relatively. Most 

1 
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of thQ aetivities that go on in libraries look to the eolleetioii 
and the use made of it for their raison ilitr^» 

Often the library's eollection of books and periodicals is 
evaluated on the assumption that the ©tate of the eolleetion will 
provide the best concrete evidence of how the library is fulfil- 
ling its misgion. The evaluation or survey of the collection may 
aim at such secondary goals as discovering and making known the 
strengths and weaknesses ^ the collection for researchers, facili- 
tating library uee by acquainting the faculty with relevant col- 
lectiong, and aiding interlibrary lending. However, Edwin Williams 
saw all evaluations as aiming ultimately at the improvement of the 
collection by pointing out deficiencies as well as strengths."^ 
Louiis Wilson and Maurice Tauber saw the evaluation ofthe collection 
as being the necetjaary first step in any collection building pro- 
gram.^ Only on the basis of a preliminary evaluation of materials 
which the library already po8see£5es can the library staff formulate 
a realistic and intelligent acquisitions policy with a statement 
of priorities. Not only does the evaluation provide focus to the 
acquisitions program. William Webb of the University of Colorado 
Library argued that an evaluation can demonstrate library need^ 
to administrators in such a way that they can act upon them and 
are motivated to do so."' Several librarians saw an increased 

^Edwin E. Williams, "Surveying Library Collections," in 
Library Surveys, ede. Maurice F. Tauber and Irlene R. Stephens 
TNew Yorlc: Columbia University Press, 196?) » p. 27. 

^Louis R. Wilson and Maurice F. Tauber, The University 



Library, 2d ed. (New York: Columbia University Press 

\illiam Webb, "Project CoED: A University Library 
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.l^vel of staff profesaionaliem as feeing a by«ppoduct of tho col« 
lacfeion evaluation process. 

The literature of librarianship is replete with the princi- 
ples and techniquea to be u^ed in evaluating book collections. 
Those methods have been developed by librarians who wanted an 
anawer to the question ^•How good ±q this library eollee tion?'^ 
Some methods reflect a primary concern for qualitative information. 
Other techniquee employ quantitative measures ba^ed on statistical 
comparisons with other institutione and have little or no direct 
relationship to the intellectual content of the books themselves • 
Some aethods are very time consuming, while othertj are relatively 
quickly performed. Some methods require a knowledge of biblio<« 
graphic search techniques, while others require statistical exper- 
tise. Regardless of the methods dis^.ussed, underlying all of the 
literature is the implicit assumption that the evaluation of 
library collections lies at the heart of the professional respon- 
sibility of the librarian. This is the fundamental assumption 
upon which the following study was based. 

Collection and Development Program," Library Peeources and Tech- 
nical Services 13 (Fall 19^9): '+62. 
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CHAl^TER I' 

THl PaOBLEM: COLLECTION EVALUATION 
IN THEOKY AND PRACTICE 

gtatjemgnt ^ f Jb h e Pr ob 1 om 
The process of collection evaluation is one which concerns 
librarians of all typos o£ libraries, and which, according to the 
literature, should .occupy a central position among their profess 
sional responsibilities. The purpose of the study was to find how 
the ideal world described in the literature was reflected in the 
world of practice in college libraries in the western United States. 
The problem was to find, tihrough the use of a questionnaire, the 
extent to which the basic methods of evaluation outlined in the 
literature actually had been eaployed in the college libraries sur- 
veyed. Had librarians evaluated their collections? If so, which 
methods and tools had been used most, which had been used least? 
These were the basic questions which the study sought to answer. 

Methodology 

The general methodological approach to the problem was as 
follows. The professional literature was first searched for die- 
cussions of the rationales and methods of collection evaluation. 
On the basis of this search (the results of which constitute chap- 
ter II of this paper) a questionnaire was constructed to serve as 
a tool for surveying collection evaluation practice in college 

10 
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librarieQ. The questionnaire covered most of the basic techniques 
found in the iitaratux^©. The questionnaire was mailed to the 
directors of eollega librari©© in ten of the western United States : 
for their responses. The information from the returned question- 
naires wa© keypunched and computer tabulated into frequency distri- 
butions. The resulting data described evaluation practices in the 
libraries which responded, and provided a basis for answering the 
questions originally posed by the study: "Are college librarians 
in the west.ern States evaluating their libraries* collections?" an< 
•'Which methods and tools are most and least used by these librar- 
ians?" (For a detailed diacusaion of methodology see Chapter III 
on data collection*) 

Delimita tion of the Problea 
The study was concerned only with collection evaluation in 
academic libraries, and more specifically, with college libraries, 
as opposed to those associated with Junior colleges or universities 
The 1959 "A.L.A. Standards for College Libraries" ("Standards") 
provided the definition of the term "college library" which was 
used in identifying the population to be surveyed. According to 
the "Standards" college libraries are those which support inatitu» 
tiona of higher learning ". . . which emphasiae four«year undergradu» 
ate instruction and may or may not have graduate programs leading 
to a Master's degree.""'' For the purposes of the study, then, a 
"college" offered at least a Bachelor's degree and at most a 

^"A.L.A. Standards for College Libraries," College and 
Research Libraries 20 (July 1959): 2?^. 
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Master*© degree in on© or niore subjects. Junior collegea offering 
trade« technical education and an Aasoeiate dc?groe, and universities 
stressing advanced research beyond the Master^ a degree were both, 
excluded. There wore other reasons for excluding these two types 
and settling on the college library* Too often, junior ccllegea 
lack the size and financial support necessary to a fully function- 
ing library operation. On the other handi the problems of collec- 
tion evaluation in a library supporting diverse and advanced 
research by graduate© and faculty are increased by a raagnitude over 
those of the college library* 

The concern of the study wa© to examine what tnese college 
librarians had done regarding collection evaluation. The study 
did not deal with what these librarians thought they ought to have 
done. The ©tudy sought to describe practice, not attitudes per se. 

Because of the centrality, in theory at least, of collection 
evaluation to library functions, the researcher raisee inevitably 
at every turn other closely related issues which in themselves 
could constitute worthy topics for research, and which at the 
least invite comment. The area of acquisition© is a case in point « 
It is nearly ifflpossible to separate the processes of collection 
building and collection evaluation since both employ parallel pat- 
terns • For example, acquisitions programs will usually specify 
depth levels to which collecting in the various subject areas is 
to be done, e.g., basic reference, basic instruction, working col- 
lection, and definitive research collection. These same basic 
classifications are used in evaluating the collection. Thus, 
collection building and collection evaluation are two sides of the 
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same coin. Th^ study foeuaed on the evaluation aspect* 

Guy Lyle suggested that a collection evaluation aheuld 

include the acquigitione prograia and procedures of the librax^yt^ 

This make§ eminent sense for the practicing librarian^ but fflakos 
the topic .unmanageable for a research project of the scope 

envisioned here. While it is true that wise Requisitions policies 

i 

for current materials wi?,l result over time in an excellent eol« 
lectioni this atudy dealt only with the evaluation of collections 
at a given point in time, the present, Mary Cassata and Gene Dewey, 
librarians at the State University of New York at Buffalo, provided . 
support for this decision in asserting that the methods of selection, 
of current materials have no direct relationship to the evaluation 
of the library's extant collectionse Thus, selection proceduresi 
acquisitions policies, and subject profiles for blanket-order or 
approval plans, while being closely related to collection evalua« 
tion,-were excluded from direct consideration in the questionnaire 
and the paper ^ 

Library statistics are most important in collection evalu- 
ation theory and practice. Yet the practice of collecting these 
statistics is in a state of chaos. The study was concerned only 
with the question of whether statistics had been collected and 
consulted, and specifically which statistics had been collected. 
The study was not concerned with the standardization or validity 

^Guy R. Lyle, The Administration of the Co llege Library, 
3d ed. (New York: H. W. Wilson, 1951), p. 4oi. 

Mary B. Cassata and Gene L* Dewey, •^The Evaluation of a 
University Library Collection: Some Guidelines,'* Librarjr 
Resources and Technical Services 13 (Fall I969): ' " 

13 
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of the statistic© colloeted^ or the preeedures used in genQrating 
thorn* Both library standards and aeereditation requirementis were 
excluded from explicit treatment in the study, in spite of the 
fact that they loom large in the background of collection evalu- 
ation activities. 

Finally I to underscore a point made earlier , the study did 
not deal explicitly with attitudes or motivations of librarian© in 
collection evaluation activities* Nor did it deal with long-term 
result© of such evaluations. The only concern was with the fact 
that evaluation activities had or had not taken place i and that 
various types of evaluation tools and procedures had or had not 
been used* 



The research plan was neither constructed nor intended to 
generate data by which hypotheses could be statistically tested*. 
The study was of a purely descriptive nature* The data from the 
questionnaires did yield percentages and frequency distributions 
which provided a description of evaluation practices within those 
libraries in the population which returned the questionnaire* It 
was assumed that 1) quantitative techniques involving the use of 
library statistics v;ould be used by a higher percentage of the 
libraries responding than qualitative techniques involving biblio- 
graphic checking; 2) in the majority of libraries responding col- 
lection evaluation would be of the limited type involving specific 



parts of the collection, rather than comprehensive; and 3) in the 
majority of libraries collection evaluations would not be formal- 
ized by final written status reports and recommendations* 



Hypotheses 
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CHAPTER II 
COLLECTION EVALUATION IN THE LITERATURE 

Introduction 

A search of the literature revealed one basic principle of 
collection evaluation which is applicable broadly regardless of 
the particular methods employed* Any collection evaluation must 
be based on a conscious and deliberate consideration of the goals 
and objectives of the library."^ A regularly updated, written 
statement carefully determining and clearly stating the objectives 
of the library should serve as the framework within which an objec- 
tive evaluation of the collection can bejnade* This principle of 
tying the evaluation to the objectives of the library has important 
consequences in determining which specific methods and tools should 
be used. 

Two other ideas have general relevance* First, the tech- 
niques discussed can be used within the context of a comprehensive 
and systematic evaluation of the library's entire collection, or 
in more limited evaluations which focus on specific subject portions 
of the collection. Second, implied in all of the literature is the 
idea that genuine evaluations will produce written status reports 
or recommendations to guide future collection building* 

^George S. Bonn, "Evaluation of the Collection," Library 
Trends 22 (January 197^): 296. 
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Lewia Steig wrote^ "'Any evaluation of the book collection 
is usually entirely eubjeetive in nature and is based upon the 

opinions of librarian©, faculty ffiembare, and, all too rarolyi of 

1 

students*** While a subjective evaluation by experts is still 

coniisidered to be a most ust^ful and legitimate technique | numerous 

other techniques have been discussed in the literaturoi all of 

which are calculated to move evaluation from the purely subjective 

to the objective realm. These techniques have been broadly claesi- 

fied by Alan Covey as being either primarily qualitative or quanti«» 
2 

tative. Qualitative techniques are concerned with the informational 
quality of the books within the context of the individual library^s 
situation* The quantitative approach to collection evaluation 
employs the use of statistics exclusively, and is not explicitly 
concerned with the informational qualities of the collection* It 
is perhaps more accurate to say these methods assume that the aspect 
of quality is reflected in the various statistical indexed that are 
used. 

Quantitative Techniques of Evaluation 
Covey stressed the desirability of qualitative criteria 
over the quantitative variety.^ Guy Lyle flatly denied the pos- 
sibility of measuring the adequacy of the collection in quantita- 
tive terras. "To iudge a collection superior cr inferior on the 

■'"Lewis F* Steig, "A Technique for Evaluating the College 
Library Book Collection/* Library Quarterly 13 (January 19^f3)j 

2 

Alan D. Covey, "Evaluation of College Libraries for Accre- 
ditation Purposes" (Ph.IX dissertation, Stanford University, 1955), 
p# 61. 

-'ibid. .... 
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basis of the voluma holdings is as absui'd as rating a college on 
thQ basis of its onrolraent Nevertheless, various statistics 
and a formula based en quantitative measures, the Clapp-»Jordan 
formula, are regularly used by college librarians in making evalu» 
ationa pf eolleetion adequacy. 

Collection of Statistics 
Among the most commonly collected library statistics are: 
total volumes held, volumes added per year, subject balance of the 
collection, unfilled book requests, interlibrary loan requeate, 
Circulation figures, and book expenditures. 

Total Volumes in the Collection 

This measure is simply a straight count of the total volumes 
in the library. It may be broken down by subject area or class of 
material, and it is used in the per capita indexes which are often 
reported in statistical sources. In spite of Lyle's objections, 
it is widely agreed that library size, particularly in the academic 
area, does reflect quality to a certain degree.^ 

Volumes Added Per Year 

Again, this measure is simply a straight count of total 
acquisitions per year. Some consider this figure to be more 

■^Lyle Administration , p.'399» 
2 

For surveys of the quantitative methods discussed below 
see the following: Bonn, "Evaluation of the Collection," pp. 26?- 
7^; Covey, "Evaluation of College Libraries," pp. 6l-72j and 
Elizabeth 0. Stone, "Measuring the College Book Collection," 
Library Journal 66 (November 1941): 9^1-3. 

3 

"^Williams, "Surveying Library Collections," pp. 29-30. 
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significaat than the growth rate* For evaluation pus^poses it is 
UBually considered along with gross aize# This statistic reflects 
on th© recency of the collectiong 

Sub^lect Balance of th© Colloction 

This measure analyzes the eollocvion by tha proportion of 
holdings in the various subject area© for the purpose of indicat- 
ing subject strengths and weakneeae@# These figureo are often 
then compared to similar analyses of opening^day collections and 
recommended percentages. 

Unfilled Requesta 

These figures are kept for books and periodicals. They are 
of value in that they tie user needs directly to the holdings and 
indicate subject areas as well as titles that are either deficient 
or not available. 

Interlibrary Loan Reguesta 

These figures are closely related to the unfilled requests 
discussed above, as well as the circulation figures discussed 
below. Analysis of interlibrary loan requests by subject can have 
important implications concerning the state of the collections and 
the focus of the acquisitions program. 

Ci rculation Figures 

Gross circulation statistics can be useful in indicating 
library use through comparisons i and are often broken down by type 
of user. Proportionate circulation statistics by subject class 
can provide a check on the focus of acquisitions when they are 
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compared with statistics on the proportionate subject holdinga 
of the library^ 

Annual Expenditures 

Annual budget figures are given for books i periodicaXe and 
salaries* They are deemed useful in evaluating "collections on 
the assumption that collection adequacy depends on continuing 
financial support for new materials and for professional develop- 
£Qent, Nevertheless, ^^bad^^ books can be purchased as easily as 
^•good" ones* Selection makes the difference* 

r 

Clapp->Jordan Formula 

A new development in the quantitative evaluation of academic 

library collections came in 1963* when Verner Clapp and Hobert 

Jordan published their formula. Clearly drawing on approaches 

developed in the 1959 "Standards,"^ the Clapp- Jordan formula allows 

a librarian to establish a quantitative^ standard of adequacy of 

library resources for his college or university. Factors providing 

input for the formula include a carefully chosen core collection 

of about 30,000 volume^, plus a specified number of additional 

books, periodicals, and governQient documents per student, per 

faculty member, and per subject field on the Bachelor's, Master's, 

2 

and doctoral levels. The formula has received widespread consid- 
eration and use. The formula makes no differentiation between the 

•^••Standards," p. 278. 
2 

Verner W. Clapp and Robert F. Jordan. "Quantitative Cri- 
teria for Adequacy of Academic Library Collections," College and 
Research Libraries 26 (September 1965): 371-82. 
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types of information needs of the various disciplines. Because 
of this fact th@ formula givers very little information on what 
th@ internal composition of tha collection should be, either f@r 
the purpose of evaluation or of guiding acquisitions. The formula 
simply provides gross totals. The authors indicated that intel- 
ligent selection is assumed. 

Summary 

Socrates pointed out that to define man as a creature having 
two legs and no feathers is unsound, for the definition applies 
equally well to a plucked chicken* To define a "good" library col- 

i 
t 

lection, or to evaluate a collectiont exclusively by counting its 
books is perhaps equally dangerous* It is conceivable that a 
library^s collection could meet the explicit quantitative standard 
of adequacy established by the Clapp^'Jordan formula, or compare 
well statistically with other admittedly "good** libraries, and 
yet fail miserably in meeting the information needs of its public* 
Sophisticated users of library statistics recognize that caution 
must be used in interpreting them* 

The quantitative methods attempt to provide unambiguous and 
easily acquired data by which the collections may be judged. These 
techniques represent an attempt to accommodate the need for evalu- 
ation and control of the collection with the practical constraints 
imposed by the library routine and budget* Clearly, however | 
quantitative methods alone are insufficient ^ for the quality of 
information in the collections must also be determined* 
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Qualitative TeGhn igues of Eyaluation 

Assessing the quality, as oppo©«5d to the quantity, of a 
eoll©ction is a relatively difficult endeavor, yet one which must 
be undertaken if evaluation is to be meaningful. The three most 
eoDiraonly digcuBeed methods of examining the quality of the col- 
lection are: the uee of user opinion, the use of checklist biblio« 

graphies, and finally, the use of direct, physical observation of 

I 

the collection by an expert. 

User Opinion 

If libraries are meant to fulfill the information needs of 
their users, then it follows that the users should have a special 
knowledge of relevance to the qualitative character of the col- 
lection. Thoy will be acquainted with specific weaknesses and 
strengths of the collection although it is probable that the general 
state of the collection will be a matter of indifference to them* 
Harry Bach claimed an advantage for this method over bibliographic 
checking when used with faculty, because the faculty member will 
be familiar with the use of the collection by himself afriH his 
students 

If user opinion is to be effective in collection evaluation 

^For surveys of the qualitative methods discussed below see 
the following: Bonn, "Evaluation of the Collection," pp. 27^^-83; 
Covey, "Evaluation of College Libraries," pp. 72-92; and Rudolph 
Hirsch, "Evaluation of Book Collections," in Library Evaluation , 
ed. Wayne S. Yenawine (Syracuse, N.Y.: Syracuse University Press, 
1959), pp. 13-16. 

2 

Harry Bach, "Evaluation of the University Library 
Collection," Library Reeources and Technical Services 2 
(Winter 1958): 26. 
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it must be aystefflatieally sought, although this may b© done in a 
formal or an informal manner. An impressive example of the use of 
this method was the survey of the Columbia University Libraries. 
Three speeialiaed questionnaires were developed to poll the opinion 
of faculty members, refsearchere, and students, and follow-up inter- 
views were held with key faculty members. 

One difficulty in this method lies in the fact that "experts" 
sometimes disagree. Finally, even if the collection is meeting 
the needs of its users, it does not necessarily follow that the 

» 

collection is good and cannot be improved. 

Checklist Bibliographies 
Perhaps the most widely used technique for evaluating the 
quality of the information content of a collection is checking the 
library's holdings against book lists. William Randall employed 
this technique in his 1932 evaluation of several liberal arts 
colleges. The most massive use of lists in a single library sur- . 
vey was in the University of Chicago Survey of 1932. Under the 
direction of Llewellyn Raney over '♦OO bibliographies were examined 
and checked against library holdings.-' More recently the University 

■^Maurice F. Tauber, C. Donald Cook, and Richard H. Logsden, 
The Columbia University Libraries (New York: Columbia University 
Press, 1958), pp. 259-306. 

^William M. Randall, The College Library; A Descriptive 
Study of the Libraries in Four-Year Liberal Arts Colleges in the 
United States (Chicago: American Library Association and the 
University of Chicago Press, 1932). 

^M. Llewellyn Raney, The University Libraries (Chicago: 
University of Chicago Press, 1939), p. ^. 
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of Idaho published evaluation© of portions of its colloetions 

1 

whieh relied heavily on the use of eheeklists. It is perhaps 

significant to note that the 1959 "Standards'* directed that 

"Library holdings should be checked frequently against standard 

bibliographies, both general and subject, as a reliable measure 

2 

of their quality," 

When a ligt ie used as an evaluative tool the procedure is 
to check the holdings of the library against the bibliography and 
indicate the percentage of titles held, William Webb indicated 
that a eampling technique had been used initially at the University 
of Colorado to cut down the amount of checking necessary to identify 
gaps in the collection which, could then be filled,-^ The survey 
report should include the percentage figures and may also include 
lists of desiderata. If books to be acquired are listed, however, 
the process has changed from evaluation to selection and acquisi- 
tion. 

There are numerous types of lists which have been used in 
collection evaluation. Each type serves a different purpose and 
ia more or less appropriate depending upon the status of the col- 
lections and the roles envisioned for it. Some of these basic 

See the following: Richard J. Beck, "Evaluation of the 
Holdings in Science and Technology in the University of Idaho 
Library," Bo okmark 11 Supplement (June 1959): 1-25; R, W, 
Burns, Evaluation of the Holdings in Science and Technology in 
the University of Idaho Library , (Bethesda, Md,: ERIC Document 
Reproduction Service, ED 021 579» 1968): and Charles Webbert, 
"Evaluation of the Holdings in Social Science in the University 
of Idaho Library," Bookm ark 1^ Supplement (March 1962): l<»l8, 

^"Standards," p. 277, 

\ebb, "Project CoED," p. ^58. 
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typee include atandardized general lists, specialized subjeet 

bibliographiea and guides to the eubjeet literatures i lists of 

reference work@i liats of periodicalsi ad hoc liete, citations^ 
and current lists « 



College Libraries ^ Julian S treet Librar^r, and Catalog of the 
Lamont L ibrary, The first list is a list prepared originally for 
the new campuses program of the University of. California • The 
latter two are shelf lists of the undergraduate libraries at 
Princeton and Harvard respectively. Each of the three lists books 
thought to be of primary importance to a core undergraduate col«* 
lection* With this in mind, it is obvious that these lists will 
be of most use in evaluating the smaller, newer, less well-^estab- 
lishedi academic libraries, 

Specialiged Subject Bibliographies 

Lists in this group are usually published by professional, 
technical or learned societies. The group includes guides to 
subject literatures and definitive bibliographies of subject areas 
Such lists are often used in conjunction with the general listf^, 
or alone for evaluating more heavily developed collections, 

^Melvin J. Voigt and Joseph H. Treyz, Books for College 
Libraries (Chicago: American Library Association, 1967)* 

2 

Princeton University, Julian Street Library (New York: 
Bowker, 1966), 

-^Harvard University, Catalog of the Lamont Library (Cam- 
bridge, Mass,: Harvard University Press, 1953), 
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typify this group include Books for 
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Probably the most widely used list in this area is Winchell's 

1 ' 

Guide to ^ef&VQncQ Boakg , One researeher concluded that the qual- 
ity of the reference collections directly reflects the quality of 
the collections generally. 

Lists of Per iodicals 

In academic libraries the periodical holdings are of 
particular importance. Lists of preferred titles include Guy 
Lyle's Classified List of Perio dicals for the College Library, 
which now goes by the name of its new editor, Evan Farber,"^ and" 
Charles Brown's citations study, Scientific Berial6 » '^^^^ various 
periodical indexes are also useful in evaluating holdings in this 
area. 

Ad Hoc Lists 



These lists are drawn specifically for the evaluation of 
a collection by the evaluator, and thus, are matched to the 
library's particular objectives and interests. For this reason, 
ad hoc lists are considered to be considerably more effective 
and reliable gvaluators of quality in a specific library than 



■^Constance M. Winchell, Gu ide t o Refere nce Books , 8th ed 
(Chicago: American Library Association^ 1967). 



^Bonrii ••Evaluation of the Collection^" p* 277* 

^Evan !• Farber , Class ified List of Periodicala for the 
College Library^ 5th ed. (Westwood^ Mass: Faxon, 1972) • 

^Charles Brown, S^cien tific Seriale (Chicago: Association 
of College and Research Libraries, 
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basie general lists. ^ 
Citations 

The question asked wh©n using this method ia: "Could this 
research have been produced in thia library?" Sources of citations 
include thesee, dissertations, journal articlesi definitive works, 
and texts, to name severale The two basic assumptions of the 
method are first, that the two libraries being compared, th@ one 
being evaluated and the one hypothetically ueed by the author, 
are similar in size and purpose; and second, that the work being 
checked is of the type that ought to bo written in the present 
library. If either of these two assumptions does not apply, then 
the citation method is inappropriate. 

Current _ Li s t a 

This group of lists includes "best book" lists of various 
sortg, and in practice is not so much a guide to the evaluation 
of quality as it becomes an acquisitions list* 

CourBe Readi ng Lieto 

Such lists as course bibliographies will rank high in 
priority for acquisition • They arC| however i relatively lese use* 
ful for the purpose of evaluation^ 

The checklist method has been criticized on several pointe. 
Bibliographic checking is tedious^ time-consuming and costly. The 
lists th,eraeelves by their nature represent arbitrary selections 

^See Bonn, "Evaluation of. the Collection, » p. 273, and 
ilirsch, "Evaluation of Book Collections," p. 15# 
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of titles which have no aeeeesary relationship with the particular 
needs and goalg of the library being evaluated. Published lista 
rapidly become outdated unless they are regularly revised. The 
list may previously have been used as a seleetion^aequisition 
guide, in which case its value as an evaluator is nullified. The 
list cannot take into account books which the library has but which 
do not appear on the list. Yet, such books may he equal to! or 
better than, the books which appear on the list. Finally, ^me 
critics maintain that because standards of quality are so elusive, 
bibliographic checking cannot evaluate quality any more effectively 
than the statistical approach. The result with a checklist survey 
is simply a statistic, too, the absolute number or percentage of 
works listed which the library owns. In spite of its weaknesses, 
the checklist method is still considered by many to be the best 
evaluator of quality in a collection, provided the list is up-to- 
date and viewed in the light of library use."^ 

Direct Observation 
Rudolph Hirsch has labeled this method "impressionistic."^ 
(No negative connotation is intended;) Lyle refers to this method 

.en- 
title and subjective, yet it Is still considered by many to be 
legitimate and useful. The method requires a subject expert who 
is very familiar with the literature and with the library. To 



as "first-hand examination."^ The technique is admittedly unsci( 



1 

Bonn, "Evaluation of the Collection," pp. 275, 279. 

2 

Hirsch, "Evaluation of Book Collections," p. 13, 
^Lyle Administration, p. 399, 
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such a person, direct observation can indicate such factor© as 
size, balance^ Bcope, deipth and recency of the collections^ 

Summary 

The search of the literature revealed numerous evaluative 
techniques which, for the purposes of exposition here, were classi- 
fied as being primarily either qualitative or quantitative laeasures, 
although the distinction on close examination begins to break down* 
Generally speaking, qualitative measures emphasize the information 
content of the books held, while quantitative measures deal with 
the collection in the aggregate through the use of statistics* It 
was seen that strengths and weaknesses are associated with each 
technique and tool discussed, and that, consequently, the evaluator 
would have to exercise judgment in their selection and use. There 
was general agreement in the literature that methods from both 
groups should be used simultaneously in complementary fashion in 
any collection evaluation, either comprehensive or limited in 
scope, in order to provide checks against the weaknesses of each 
technique. Finally, any evaluation must be done on the basis of 
a consideration of the goals of the library being evaluated. And 
if the evaluation is to have an impact on collection development, 
it w^s thought that a written report of some type would improve 
that prospect. 
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CHAPTER III 

COLLECTION OF THE DATA 

The Questionnaire 
The search of the literature identified most of the basic 
principles, methods and tools associated with collection evaluation 
in academic libraries. On the basis of this information a question- 
naire was constructed to survey the use of the various methods in 
the college library setting* The questionnaire was short, consist- 
ing of thirty-eight closed questions on two pages, and reflected 
collection evaluation as a process of interrelated steps. The pro- 
cess begins with a written statement of library goals, and is fol- 
lowed by the use of the various methods including the collection 
of statistics, the application of the Clapp-Jordan formula, the use 
of user opinion surveys, the use of checklist bibliographies, and 
the use of direct observation of the collection. The process ends 
with a written statement on the status of the collection and on 
recommendations for future collection building. Two of the questions 
explicitly asked whether a comprehensive evaluation involving all 
of the collection, or limited evaluations involving only portions 
of the collection, had been done, and if so, when it had been accomp- 
lished. 

The last seven questions asked for the following specific 
statistics for each library: total volumes held in 1970-71, 

Er|c Z3 
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volumes added in 1970-71| book expenditures in 1970-71, volumea per 
Full Time Equivalent (FTS) student in 1970^ oxpendituroa per FTE 
Btudent in 1970, librarians per 1000 FTE students in 1971 , and 
librarians a© a percent of the total library staff in 1971* In 
keeping with the convention that information which can be found 
in published sources not be requested in questionnaires, these 
figures v^'ere supplied and actually v/ritten on the individual 
questionnaires before mailing for each library found in the Library 
Statistics o f Colleges and Universitie6 >'^ If the information was 
not available in this source then the librarian was asked to furnish 
these etatisticst 

Several of the faculty members of the Graduate Department of 
Library and Information Sciences at Brigham Young University 
reviewed the questionnaire making helpful suggestions which were 
incorporated. The questionnaire was pretested with ten librarians 
at Brigham Young University's Lee Library during the second week in 
May. Several revisions of a minor sort resulted. (The cover let« 
ter and questionnaire are found in appendix B.). 

Identifying the Population 
For the purposes of this research, "college library" was 
defined as one which supports an aceidemic institution which grants 
at least the Bachelor's degree, and may or may not have Master's 
programs. The basic information source used to identify these 

"^U.S. Department of Health, Education and Welfare. Office 
of Education. National Center for Educational Statistics. Library 
Statistics of Colleges and Universities. Institutional Data, Fall 
1971 * (VJashington, D-CT: Government Printing Office, 1972). 
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X 

echools was the Education D irectory 1969-70* Higher EduGation. 
The Education Directory lists all American colleges and univer- 
sities by state and previdea, among other facte, information on 
the highest degree offered at each institution. Thus, it was a 
relatively simple matter to identify the "colleges" as defined 
for this study. 

Sampling techniques were not used in the study. Instead, 

I 

it was decided to survey collection evaluation practice in all 
collegia found in the eleven contiguous western United States. 
The population included 111 libraries in the states of Arizona (2)| 
California (55) i Colorado (10), Idaho (^), Montana (6), Nevada (l), 
New Mexico (^), Oregon (15) i Utah (3), and Washington (ll)# The 
state of Wyoming had no academic institutions that met the estab-^ 
lished definition of college* (See appendix A for the list of 
libraries surveyed^) 

Having identified ae of 1970 all of the colleges in the 
ten western States listed above, the American Libra r y Dire ctory 
was consulted to identify the names of the library directors ae 
well as the mailing address for each library* The cover letter 

^U^S. Department of Health, Education and Welfare, Office 
of Education, National Center for Educational Statistics, Educatiop 
Directory 1969-70, Higher Education, (Washington, D.G.j Govern- 
ment Printing Office 197077^ 

2 

The Claremont Colleges, Glaremont Men's, Harvey Mudd, Pitzer, 
Pomona, and Scripps, were not included in the population because 
they are supported jointly by one library^ Honnold Memorial Library* 
It was decided that this fact of joint usership would make Honnold 
Library atypical of the other libraries in the population. 

•^Helaine MacKeigan, comp», American Library Directory* 
1972-73 . 28th ed. (New York; R.R* BowkeF'Comp^a^^ 
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a6 

was in each case addressed to the director t He wae invited to 
respond personally to the questionnaire or to have another staff 
member more closely associated with collection development answer 
the questionnaire instead. 

The refined questionnaire was mailed under the cover letter 
to the directors of the 111 libraries in the population on May 17, 
19?'*, and it was requested that the completed questionnaire be 
returned ae soon as possible. A stamped, self-addreseed envelope 
was provided for this purpose. 

Analyjsis of the Survey Returns 
By June 21, the cut-off date for returns, eighty completed 
questionnaires had been received of the 111 originally mailed. No 
follow-up procedures were used for those not responding. This 72.8 
percent return was considerably higher than the 50 percent return 
which had been expected. While it xas conceivable that the remain- 
ing 27*2 percent of the population might change the results obtained 
from the survey , the author thought it unlikely. 
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CHAPTER IV 
PREPARATION AND ANALYSIS OF THE DATA 
Preliminarieg 

The information from the eighty questionnaires was transfer*- 
red to computer cards and the Statistical Package for the Social 
Sciences (SPSS) computer program was used to generate percentages 
and frequency distributions for the various categories established 
in the questionnaire » In addition^ responses for the questions on 
comprehensive and limited evaluations were cross-tabulated with 
the three library variables of total volumes held^ volumes added i 
and librarians as a percent of the total library staff* 

The research design had important implications for the types 
of analysis which were appropriate for the data, and for the. kinds 
of statements that could be supported by the data. Of prime impor^ 
tanee for the analysis was the fact that no sampling techniques had 
been used» Rather , a population had been defined, every member of 
which had received the questionnaire. Consequently, statistical 
testing of the data was inappropriate. The results of the survey 
were descriptive only of the activities of the libraries responding 
to the questionnaire. 

Quantitative Techniquea 
The quantitative methods surveyed included the eollection 

27 
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of statistics and the application of the Clapp-Jordan formula* 
The. overwhelming amjority of the responding libraries (91* 3 percent 
claimed to collect statistics of one sort or another. The total 
volumes and volumes added atatiatics were the most widely collected 
varieties with 83»8 percent and 83. 1 percent respectively of the 
ragpondent@ indicating that thoy used these measures. Circulation 
figures and annual book expenditure statistics were next with 70 
percent and 72.5 percent respectively. Proportional analysis of 
holdings I and interlibrary loan requests were both checked by 57«3 
percent of the respondents. Finallyi unfilled book requests were 
checked by one- fourth^ or 23 percent, of the respondents. Thus, 
those statistical measures which give relatively more general 
information about the qualitative character of the collections , 
proportional analysis of holdings by subject group, interlibrary 
loan requests, and unfilled book requests, were less widely col» 
lected and used than those which deal with gross totals. 

Less than one^fifth of the respondents (l8.8 percent) 
claimed to have applied the Clapp«Jordan formula to their library. 
Of these libraries, three had collections of less than 50,000 
volumes. Since the formula requires a basic core collection of 
more than 50,000 volumes before any of the other factors come into^ 
play, the author wondered of what possible value the formula had 
been to them. It is probable, then, that the l8.8 percent figure 
as a description of the authentic use of the formula among the 
respondents is inflated (see Graph 1). 
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tStatis.tics Collected 91.5% 
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Total Volumes 83'8% 
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Proportional Analysis of Holdings 57.5% 

mm. 



Unfilled Book Requests 25% 



I Interlibrary Loan Requests 57.5% 
Circulation Figures 709^ 




Graph !• Percentages of Responding Librar4.es 
Using Various Quantitative Techniques in Collection 
Evaluation* 
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The qualitative methods Burveyod ineludod the use of user 
opinion surveys , checklist bibliographies » and direct observation. 
The survey question on uaer opinion was phrased to emphasise the 
idea that opinion must be aystematically solicited; of the re©pond« 
ing libraries I 26.3 percent claimed to have done 6o« Ucser groups 
surveyed were faculty (22«3 percent), students (21#3 percent) » and 
librarian© (8.8 percent). 

The use of checklist bibliographies was by far the most 
widely used qualitative method with 92#5 percent of the responding 
libraries claiming to have used it* An analysis of the types of 
lists used provided some insights into the process. The least--used 
type was the ad^ hoc list with 21»3 percent. Because such lists can 
be specially tailored' to the goals of the individual library they 
ar© most highly recommended in the literature^ The lists most 
criticized in the literature were the basic general lists which 
82«3 percent of the respondents claimed to have used. Current 
**best books'^ lists (60 percent) and course reading lists (65 percent) 
were used by a majority of libraries responding. These kinds of 
lists were considered in the literature to be less, valid as evalu« 
ative tools than other kinds of lists. Winchell's standard work 
was used by nearly three-fourths of the respondents (72.5 percent), 
and subject bibliographies were used by 71.3 percent. Lyle's 
periodicals list was used by about one-half (53 percent), while 
the use of citations in evaluation was reported by only 25 percent. 
Exactly 50 percent of the respondents claimed to have used direct 
observation, the third qualitative technique surveyed (see Graph 2)<, 
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Faculty Surveyed 22,5% 



[Students Surveyed 21.3% 
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[Librarians Surveyed 8.8§ 



Checklist Bibl io^pffiphies Used 02.5% 
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Basic General Lists 82,5% 
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Sub,iect Liternture Guides 71.3% 
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Lyle's Classified List of Periociicals 539^ 
Ad Hoc Lists 21*3% 
Citations 25% 
Best Eookn Lists fiO% 



Course Heading Lists f^3% 



Dir GC t Observation 50% 
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Graph 2, Percentan:es of Responding Libraries Using 
Various Qualitative Techniques in Colloction Evaluation. 
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Comprehensive or Limited Evaluation 

Having ©urveyod the use of the individual evaluation tech- 
niquea^ the questionnaire asked whether formal collection evalua^ 
tionsi either comprehensive or limited i had been performed* The 
question on comprehensive evaluations required that four criteria 
be met in order to answer positively • First , the evaluation must 
have extended over a discrete period of time, thuB requiring that 
it be organised; eecondi the evaluation must have dealt with the 
library collections in their entirety} third, the evaluation must 
have used eheckliets of some sort; and fourth, quantitative fflea» 
eures must have been used* A second question asjced if subject 
portions of the collection had been evaluated using both checklists 
and statistical measures* Among the respondents, 70 percent claimed 
to have performed evaluations of limited scope, while only ^7*3 
percent indicated that comprehensive evaluations had been performed 
within the definitions established in the question (see Graph 3)« 

These two questions on the scope of evaluation were cross-* 
tabulated with the data on library size in volumes, acquisitions 
rates in volumes added, and librarians as a percent of the total 
library staff, to see how these factors related to evaluation in 
the libraries respondinf?. There appeared to be a tendency for the 
use of limited evaluations to increase and for the use of compre- 
hensive evaluations to decrease with increases in total volumes 
held* For example, among the eleven libraries holding less than 
30,000 volumes about 3^ percent claimed a comprehensive evaluation 
and about 63 percent claimed evaluations of limited scope. How- 
ever, among the twelve libraries holding more than 150,000 volumes, 

38 
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I Do Wot Know 6.3% 

^1^?^ Within Past Year ^15% 

I'- - — 

I 

Within 3 jYears 15% 

Within 5 Years 
I 

H Iwitnin 10 





7.5% 
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Graph 3» Percentages of Responding: Libraries Which 
Have Made Limited and Comprehensive Collection EvalUf 
a tiOns . 
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only 25 percent claimed comprehensive ©valuations while 75 percent 
elaimed evaluations of liaifced scope. With all groups but one, 
limited evaluation had been used more than comprehensive surveys 
(see Graph 4). 

Basically, the same relationship appeared to exist between 
the scope of evaluation and volumes .added per year* With an 
increase in the acquisitions rate the use of comprehensive sur« 
veys decreased while the use of limited surveys increased. Of 
the twelve libraries having acquisitions rates of less than HOOD 
volumes per year, 50 percent claimed to have made a ^comprehensive 
evaluation and 58 percent claimed to Have made limited evaluations 
Of the sixteen libraries with acquisitions rates above 10,000 
volumes about 31 percent claimed to have had comprehensive evalu- 
ations, while nearly 89 percent claimed to have had limited evalu<=> 
ations. Here again for each group limited evaluations were more 
used than the comprehensive type (see Graph 3) • 

The relationships between the factor of librarians as a 
percent of the total library staff and the scope of evaluation 
activity appeared to be less clear-cut. Interestingly, in the 
group of libraries claiming more than 80 percent librarians on the 
Staff (a number far in excess of current library standards and 
personnel trends) comprehensive evaluations were more often per- 
formed (68 percent) than the limited variety (58 percent). In 
this instance^ too, except for the group of libraries just discus^ 
sed| limited evaluations had been made by higher percentages of 
the respondents than the comprehensive type (see Graph 6). 
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Graph 4. Percentages of Responding Libraries Which Have Made 
Limited and/or Comprehensive Evaluations of Their Collections: 
Compared by Volumes Held« 
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Graph 5» Percentages of Responding Libraries Which Have Made 
Limited and/or Comprehensive Evaluations of Their Collections; 
Compared by V-oluojes Added^ 
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Graph 6. Percentages of Responding Libraries V/hich Have Made 
Limited and/or Comprehensive Evaluations of Their Collections: 
Compared by Number of Librarians as Percent of Library Staff. 
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The questionnaire was congtructod to reflect collection 
evaluation as a proeeso« The first question dealt with 9 current 
written statement of library goal© within the framework of which 
an objective evaluation could take place. Questions then proceeded 
to survey the use of the various quantitative and qualitative tools 
of evaluation. Two questions were asked on the SQOpe of the evaXu-- 
ationa which had been made, and finally it was asked if the evalu- 
ation had produced written status reports and recommendations* 
(The responses to the questionnaire are summarized in Graph 7«) 

Particular importance was attached to the concept of evalu- 
ation as a process which consists of three basic components. The 
first of these is the current written statement of goals which 
provides the framework for the evaluation # Of the libraries . 
responding^ 38.5 percent indicated that they had such a statement. 
The second component consists of the use of the evaluation tools 
themselves within a structured evaluation of either limited or com-* 
prehensive scope. Eighty-one percent of the libraries responding 
indicated that some such structured evaluation had been done. The 
final component consists of a written report on the status of the 
collections and/or recommendations for future collection building* 
again within the pontext of the writtert statement of goals. Only 
18 percent of the libraries responding* which had done some organ° 
ized evaluation* claimed that a status report or a recommendation 
after the evaluation had "always" been written. This was tl- same 
percentage; of libraries in which there was "never" any written 
feedback after an evaluation. Another 38 percent of the libraries 
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Graph ?. Summary of Questionnaires Percen ta;?*es of- 
Responding Libraries Using Various Collection Evaluation 
Techniques and Processes* 
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responding whieh had evaluated in some fashion "sometimes" wfOt@ 
reports snd reeommendatione (see Graph 3)« 
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Graph 8. The Evaluation Process; Percentages of 
Responding Libraries Having Written Statement of Goals, 
Mailing Collection Evaluation, and Writing Report and/or 
Recommendations. 
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CHAPTIK V 

CONCLUSIONS 

ReBtatem ent of the P roblem 
The study compared the principles, techniques, and pro- 
cedures of collection evaluation found in the literature with 
collection evaluation practice as found wi*-.hin college libraries 
in the western United States. The purpose of the study was to see 
if jcollege librarians had, in fact, evaluated their collections, 
and if evaluation had taken place, to identify the methods used 
and the relative degree to which they had been eaployed. It was 
assumed that quantitative measures would predominate over the use 
of qualitative techniques; that collection evaluations of limited 
scope would be more prevalent than comprehensive evaluations; and 
that evaluation activities would generally not produce written 
status reports and reeoffimendations for future collection develop- 
ment* 

Concluaions 

While the author had no reason to think that the Tsicture 
painted here of collection evaluation was not typical of other 
college libraries, etill the methods used and the data generated 
did not support generalization of the findings beyond the geographic 
area specified, nor to any other type of library withla that area, 
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Having axialyscd the data concerning the use of quantitative 
and qualitative techniques among the respondente^ the author con-- 
eluded that the first aseumptiont that quantitative techniques would 
have been used in more libraries than the qualitative methods^ wa^i 
not supported. The overall use of collection statistics (the main 
technique in the quantitative group) and of checklists (the main 
method from the qualitative group) among the population was very 
hight and almost identical* The use of statistics was reported 
by 91*3 percent of the respondentSt whi^e 92.5 percent of the 
respondents reported having used checklists # 

It was important to ask if the use of these tools and methods 
had been actually integrated into an organized process of collection 
evaluation* The answer to that question was perhaps beyond the 
power of the questionnaire as a research instrument to provide^ 

The second assumption, that limited evaluations would be 
used by a greater percentage of responding libraries than compre* 
hensive evaluations, received strong support* Of the respondents 
70 percent claimed to have performed limited evaluations while ^7«3 
percent claimed to have conducted comprehensive evaluations of 
their collections. The data indicated that the greater prevalence 
of limited evaluations was generally characteristic of all libraries 
responding, whether analyzed by gross totals in the population 
(Graph 3)f total volumes held (Graph volumes added (Graph 5)| 
or librarians as a percent of the total library staff (Graph 6)# 

The third assumption, that evaluations of either compre- 
hensive or liaited scope would generally not result in a written 
final report, was also supported by the data. Eighteen percent 
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of the respondents, which had>l60 claimed to have evaluated their 
collections, indicated that a final report had always been written. 
An equal number of evaluating libraries indicated that written 
reports had never been prepared on ^^aluatxons. Thirty-six percent 
of the respondents, which had also evaluated, claimed that final 
reports had sometimes been prepared* \ 

On the basis of the analysis of the data the author concluded 
that in the college libraries surveyed, librarians claimed to have 
made wider use of the evaluative tools than had been anticipated, 
yet it was thought that there had not been a proportionate amount 
of authentic evaluation that had taken place. The author contended 
that because of a failure to conceive of the evaluation of collection 
adequacy as a process, much of the evaluation activity that had 
taken place was not functional. Of the librarians responding, 
81 percent claimed to have performed some organized evaluation of 
the collections, yet less than one-half of these (38.5 percent of 
those responding) had a current statement of library goala. More 
than 50 percent of the librarians responding had no statement of 
goals or objectives which could serve as the basis for an evalu- 
ation. Finally, in only I8 percent of the libraries responding 
was a final report of the evaluation always prepared. 

It would be arbitrary to insist that no useful collection 
evaluation can be done without producing written results. However, 
the author was not convinced that the negative assumption, was not 
warranted. If the evaluation was not taken seriously enough by 
the library to merit or require some written document that could 
serve as feedback to the system, then it either was not collection 
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evaluation as described in the literature, or it was non- functional 
evaluation serving no constructi<?e end but the satisfaction of the 
librarian's curiosity. If the evaluation is to guide aequisition 
poliey in the future, then documentation will be needed at least 
for the internal use of the library staff, Sueh reports provide 
for a continuity of poliey. Edwin Williams contended, however, 
that solleetion evaluations are very often made for the purpoe© 
of exerting influence on decieion-making outeide of the library 
organization, notably within the budgetary machinery of the college 
or university."'' If ©ither of these considerations is valid, then 
to neglect the final step of making a written report which meets 
the bureaucratic needs discussed above is simply to short-circuit 
the evaluation process and to dissipate its thrust. On the basis 
of this line of argument, the author concluded that in only about 
one-fifth of the libraries responding had collection evaluation 
been performed in such a way as to maximise its impact on the devel- 
opment of the collection. 

Recommendations for Further Study 
It was pro|Dable that some libraries in the western States 
which met the established definition of college library in 197^ 
were not included in the population surveyed. The statistical 
source used in identifying the population contained information 
which was valid for 1969, not 197^ • In the interim, junior col- 
leges could have become colleges. By the same token, some colleges 
could have become universities by adding doctoral programs. Further- 
more, schools were listed in the Education Directory only if they 

^Williams, "Surveying Library Collections," pp. 35-6. 
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had furnished current information for inclusion by a certain cut-- 
off date. Finallyi simple physical oversight when using the source' 
to identify the population cou^ld account for the absence of a 
library which should have been included. The author was confident 
that the population which was identified for the survey included 
the vast majority of college libraries in the states surveyed. 

A matter of greater significance to the study involved the 
adequacy of the definition of "college library" which was used. 
The definition required that very dissimilar libraries be treated 
as though they were in fact similar. Another study of this sort 
should perhaps be more selective in choosing the libraries to be 
surveyed. Libraries supporting educational programs of similar 
scopei in breadth as well as depth i could be investigated. 

This study identified three library variables and described 
what appeared to be their relationship to the collection evaluation 
process. It would be useful to test out other variables and 
identify patterns of collection evaluation with other types of 
libraries, e.g., university libraries. 

While this study was concerned only with describing collec«- 
tion evaluation activity within the college library setting, other 
focuses on the problem would have particular relevance t Of great 
significance would be a study of practicing librarians^ attitudes 
about the role that collection evaluation can and should play in 
the process of collection building.^ It would be useful to know 
whether practicing college librarians found the concepts and prin- 
ciples discussed here to be unrealistic and incompatible with the 
facts of library life, and, if so, why? 
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Ultimately, tha limitation© of the 'questionnaire format 
as a tool for gathering the kinds of information sought by this 
stuay must oe considered. A library may celleet statistieg and 
leave thera in the book, never to refer to them. It is one thing 
to use a checklist for evaluation purposes and a far different 
thing to use it unintelligently as a buying guide, ''If it's good 
enough for Harvard's Lament. Library, then it'e good enough for us* 
Order every book we don't have." There is no way that such varied 
uses, or misuses, of the tools of evaluation can be differentiated 
at long distance through a questionnaire. To find how these tech- 
niques were actually applied within the libraries studied would 
have required at least some personal contact in addition to, or 
in place of, the simple questionnaire. With these consideratioas 
in mind, the author thought it would be useful to identify "evalu- 
ating" and "non-evaluating" libraries and to study personally 
these individual organizations in some depth. The study would 
determine what effect, if any, the use of the various evaluation 
techniques and processes has on the library in terms of the col- 
lections and the way the library is able to respond to the infor- 
mation needs of its patrons. The question to be answered would 
be, "Are the benefits claimed for collection evaluation real?" 
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APPENDIX A 



LIST OF COLLEGE LIBRARIES SURVEYED 



Arizona 

Grand Canyon College, Fleming Library, Phoenix 
Prescott College Library, Preecott 

California 

American Baptist Seminary of the West, Clark Hall Library, Covina 

Armstrong College Library, Berkeley 

Art Center College of Design Library, Los Angeles 

Asusa Pacific College, Marshburn Library, Azusa 

Bethany Bible College Library, Santa Cruz 

Bioia College, Rose Library, La Mirada 

California Baptist College, Gabriel Library, Riverside 

Calif ornia- College of Arts and Crafts, Meyer Library, Oakland 

California Lutheran College Library, Thousand Oaks 

California State Polytechnic College Library, Pomona 

California State Polytechnic College Library, San Luis Obispo 

California State College-Dominquez Kills Library, Dominquez Hills 

California State College-Fuller ton Library, Fullerton 

California State College-Hayward Library, Hayward 

California State College-Long Beach Library, Long Beach 

California State College-San Bernardino Library, San Bernardino 

Chapman College Library, Orange 

College of Notre Dame, Belm6nt 

Dominican College of San Rafael, Alemany Library, San Rafael 

Fresno State College Library, Fresno 

Holy Names College, Gushing Library, Oakland 

Humboldt State College Library, Areata 

Immaculate Heart College Library, Los Angeles 

Los Angeles Baptist College and Theological Seminary, Powell 

Library, Newhall 
LaVerne College, Hoover Library, LaVerne 

Loyola University of Los Angeles, Von Der Ahe Library, Los Angeles 
Menlo College and School of Business Administration, Bowman 

Library, Menlo Park 
Mills College Library, Oakland 

Monterey Institute of Foreign Studies Library, Monterey 
Mount Saint Mary's College, Co3 Library, Los Angelps 
Northrop Institute of Technology, Alumni Library, Inglewood 
Occidental College, Clapp Library, Los Angeles 
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Otis Art Institute of Los Angele© County Library, Loe Angeles 
Paaadena College Library, Pasadena 

Pacific Christian College, Huret Library, Long Beach 

Pacific College, Hiebert Library, Fresno 

Pacific Oaks College, Norman Library, Pasadena 

Paeifie Union College, Nelson Library, Augwin 

Pepperdine University Library, Loa Angeles 

Sacramento State College Library, Sacramento 

Saint Patrick's College Library, Mt, View 

San Francisco Art Institute, Bremer Library, San Francisco 

San Francisco Conservatory of Music Library, San Francisco 

San Jose Bible ColleRe, Memorial Library, San Jose 

University of San Francisco, Gleeson Library, San Francisco 

Simpson Colle^^e, Start-Kilgour Library, San Francisco 

Southern California College, Budge Library, Costa Mesa 

Sonoma State College Library, Rohnert Park 

Stanislaus State College Library, Turlock 

Russell College Library, Burlingame 

West Coast University, University Center Library, Los Angeles 
Weet Coast University-Orange County Center Library, Orange 
Westmont College, Voskuyl Library, Santa Barbara 
Whittier College, Wardman Library, Whit tier 
Woodbury College Library, Los Angeles 

Colorado 

Adaros State College, Learning Resources Center, Alamosa 

Colorado College, Tutt Library, Colorado Springs 

Conservative Baptist Theological Seminary, Thomas Library, Denver 

Fort Lewis College Library, Durango 

Loretto Heights College, Stanton Library, Denver 

Metropolitan State College Library, Denver 

Regis Coil lege, Dayton Library, Denver 

Saint Thomas Seminary Library, Denver 

Southern Colorado State College Library, Pueblo 

Temple Buell College, Porter Library, Denver 

Idaho 

timi m I I 

Boise State College Library, Boise 
College of Idaho, Terteling Library, Caldwell 
Lewis and Clark State College Library, Lewiston 
Northwest Nazarene College^ Riley Library, Nampa 

Montana 

Carroll College Library, Helena 
College of Great Falls, Great Falls 
Eastern Montana College Library , Billings 

Montana College Mineral Science and Technology Library, Butte 

Northern Montana College Library, Havre 

Rocky Mountain© College, Adams Library, Billings 
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Nevada 

University of Nevada at Las Vegas, Dickenson Library, Las Vegas 

N&w Mexico 

College of Santa Fe Library, Santa Fe 
New Mexico Highlands University Library, Las Vegas 
University of Albuquerque, St. Joeeph'e Library, Albuquerque 
Western New Mexico University, Miller Library, Silver City 

Oregon 

George Fox College, Sharabaugh Library, Newtaerg 
Lewis and Clark College, Watzek Library, Portland 
Linfield College, Northup Library, McMinnville 
Marylhurst College, Shoen Library, Marylhurst 
Mt.! Angel School Library, Saint Benedict 
Mount Angel College Library, Mount Angel 
Multonomah School of the Bible Library, Portland 
Northwest Christian College Library, Eugene 

Oregon Technical Institute Library, Oretech Branch, Klamath Falls 

Pacific University, Scott Library, Forest Grove 

Reed College, Uauser Library, Portland 

Southern Oregon College Library, Ashland 

Warner Pacific College, Linn Library, Portland 

Western Baptist Bible College Library, Salem 

Western Conservative Baptist Theological Seminary, Cline-Thunnell 
Library, Portland 

Utah 

Southern Utah State College Library, Cedar City 
Weber State College Library, Ogden 

Westminster College, Nightingale Library, Salt Lake City 

Washington 

Fort Wright College Library, iSpokane 
Gonstago University, Crosby Library, Spokane 

Northwest College of the Assemblies of God Library, Kirkland 

Pacific Lutheran University, Mortvedt Library, Tacoma 

Saint Martinis College Library, Olympia 

Seattle Pacific College, Weter Library, Seattle 

Seattle University, Leraieux Library, Seattle 

University of Puget Sound, Collins Library, Tacoma 

Walla Walla College Library, College Place 

Whitman College, Penrose Library, Walla Walla 

W]?iitworth College, Cowles Library, Spokane 
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Hay 16, 197k 



Dear 

I am studying the evaluation of library collectione. The 
enclosed questionnaire, which X am circulating to the di^'ectors 
of academic libraries in ten of the western states, is meant to 
provide me with descriptive data on collection evaluation prac- 
tices in those libraries* 

I solicit your help in my study* I am anxious to have 
either your personal responses to the questionnaire or those of 
another librarian on your staff who might be more closely asso^ 
ciated with collection development than you* I want to make it 
clear that your responses will be kept confidential* I will 
make no effort to identify sets of data with individual librar- 
ies* I am interested only in the data in the aggregate* The 
information on each questionnaire will be keypunched and tabu- 
lated into frequency distributions by a computer* 

I would be very grateful if you would give the question- 
naire five minutes of your time at your earliest convenience and 
then mail it back in the stamped, self-addressed envelope which 
is enclosed* 

I do appreciate your help. Thank you. 

Sincerely t 



Douglas M, Abrams 
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COLLECTION EVALUATION IN ACADEMIC LIBRARIES 



Please ignore the numbering whieh ie used only for com- 
putex* tabulation purposes. 



1. Do you have a current written statement of goals, objectives 
and functions to be served by your library which includes a 
collection development statement? 

(1) No written statement 

^ (2) Written statement, but out of date 

^ (3) Yes» current written statement 

ik) Other . (specify) _______ 



~ — i 

2. Are library statistics, like those listed in #3-9 directly 
below, systematically collected in your library? 
_ (1) No 
^ (2) Yes 

If your answer to #2 is yes, specifically which of the follow- 
indexes have been used in the evaluation of the collections ? 
(Mark all appropriate answers •} 

^ ^ 3* Total volumes in the collection 

Volumes added per year 

5. Proportional analysis of holdings by basic subject class 

6. Unfilled book requests 

„ 7. Interlibrary loan requests by your library's patrons 

, 8. Circulation figures for groups of users, or proportional 

analysis of circulation statistics by subject classes 
_____ 9. Annual expenditures for books, periodicals, and salaries, 
and comparison of similar data from comparable libraries 
10. Other (specify) ' 

13. Has the Clapp-Jordan formula been applied to your library to 
establish a quantitative standard of adequacy of library 
resources for your college? 

„ (1) No 
(2) Yes 

14. Have formal user opinion surveys been used in evaluating 
collection adequacy? 

(1) No 

(2) Yes 

If your answer to #1^* is yes, which of the following groups 
of users were queried? (Mark all appropriate answers.) 

15. Teaching faculty 

16. Students 

17. Librarians 

18. Other (specify) ________________________ 

ERIC • GO 
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21, Havo checklist bibliographies been used in your collection 
evaluations? 

(1) N© 

(2) Yea 

If your answer to #21 is yes, which of the following types 
of lists have been used? (Mark all appropriate answers* ) 

22. Basic general lists like Books for College Libraries 

or catalogs of libraries like Harvard's Lamont, or 

Princeton's Julian Street 
23» Guides to subject literatures; specialized subject 

bibliographies 
2^. Lists of reference works like Winchell's Guide to 

Ref erence Books 
25# Lists of periodicals like Lyle's Classified List 

of Periodicals 

2G. Ad hoc lists drawn specifically for your evaluation 

project 

27, Citations (footnotes, bibliographies) of theses, 
journal articles, definitive works, etc, 

28, Lists of "besf books published in specific or cur- 
rent years 

^ 29, Reading lists and bibliographies for courses taught 

on your campus 

30, Other (specify) 



33* Has direct and organized observation of the collection to 

determine size, scope, depth, and recency been used to eval- 
uate your collections? 

(1) No 

(2) Yes 

3^* Has a systematic and comprehensive evaluation of your lib- ' 
rary's collections been done? (The question implies that the 
evaluation process 1) extended over a discrete period of time; 
2) involved most of the library's collections; 3) employed 
checklists of some sort; and k) used quantitative and other 
techniques • ) 

(1) No^ there has been no such evaluation 
^ (2) Yes, within the past year 

(3) Yes, within the past 3 years 

(^) Yes, within the past 5 years 

(5) Yes, within the past 10 years 

(6) Yes, more than 10 years ago 

(7) Do not know 

35* Have specific portions of the collections, e,g# psychology 
or physics, been evaluated within the past 5 years using 
checklists and other evaluative techniques? 

(1) No 

_ (2) Yes 

(3) Do not know 
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36. Did the evaluatioa(s) , either eomprehensive or limited, 
result in a final written report on the status of the c©l-= 
lections? 

(1) Written report(s) never prepared 

^ (2) Written reportCs) soaetimes prepared 

(5) Written reportCs) prepared for eaeh evaluation 

^ (^O Do not know 

37. Did the evaluation(s) , either eompreheneive or limited, 
result in a final written etatement which included recomaiend'a- 
tions for future collection development? 

(1) No recommendations proposed 

^_ (3) RecoBifflendations sometimes proposed 

_ (3) Recommendations proposed with each report 

(^0 Do not know 



The following data for your library were obtained from the Statis - 
tics of College and University Libraries 1970-71 . The data are 
given below so that the anonymity of each questionnaire can be 
maintained in the keypunching process. Data for items marked NA 
below were not available in my source. If they are conveniently 
available to you please supply them for 1970-71. 

3S. _ Total Volumes held in 1970-71* _____ 

39. Volumes added in 1970-71* ______ 

^0. Expenditures for books and other printed 

materials 1970-71 

'♦I. ^ Volumes per FTE Student, Fall 1971 

^2. Expenditures per FTE Student, Fall 1970 

^3. _____ Librarians per 1,000 FTE Students, 
Fall 1970 

kk, Librarians as percent of total regular 

library staff (FTE), Fall 1971 



• Exclusive of government documents and mocroforms; inclusive of 
bound periodicals. 



THANK YOU FOR YOUR HELPI 
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r^OTE: Responses to questions 38-44 were keyed into th© following 
breakdowns for the keypunching and tabulating process after the 
questionnaire was returned. 

38. Total Volumes held in 1970»71 



(1) 


0-29,999 


(2) 


30,000-49,999 


(3) 


$0,000-69,999 


W 


70,000-99,999 


(5) 


100,000-149,999 


(6) 


150,000-249,999 


(7) 


250,000 and above 


~ (8) 


Not available 


Volutnes 


added in 1970-71 


(1) 


0-1,999 


(2) 


2,000-2,999 




3,000-3,999 


w 


4,000-5,999 


~ (5) 


6,000-9,999 


(6) 


10,000-19,999 


(7) 


20,000 and above 


(8) 


Not available 



40. Expenditures for books and other printed materials 1970-71 
_ (1) 0-59,999. 

(2) 810,000-S19,999 

(3) $20,000-139,999 

(4) $40,000-599,999 

(5) 8100,000-5199,999 

(6) 8200,000 and above 

(7) Not available 

41. Volumes per FTE Student 
(1) 0-19.9 

(2) 20-39.9 

_ (3) 40-49.9 

(4) 50-79.9 

(5) 80-119.9 

(6) 120 and above 

(7) Not available 

42. Expenditures per FTE Student 
(1) 0-839.99 

(2) 840-859.99 

(3) 860-874.99 

(4) 875-889.99 

(5) 890-8104.99 

(6) 8105-149,99 

_^ (7) 8I5O and above 

(S) Not available 
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«*3» Librarians per 1000 i-TE Students 

(1) 0*1.4 

(2) 1.5-2.4 

(3) 2.5-3.4 

(4) 3.5-4.9 

..^^ (5) 5»0 and above 
(6) Not available 

44, Librarians as percentage of total library staff 

(1) 0-29.9% 

(2) 30-34.995 

(3) 35-39. 9SI5 

(4) 40-49. 99S 

(5) 50-59.936 

(6) 60-79.996 

(7) 8096 and above 

(8) Not available 



G4 



ERIC 



,4 BEST COPY AVAILABLE 

SELECTED BIBLIOGRAPHY 



BEST COPY AVAILABLE 



o 

ERIC 



SELECTED BIBLIOGHAPHY 



Books 

Carter, Mary Duncan and Bonk, Wallace J. Building Library 
Collections . 3d ed, Metuchen, N.J.; Scarecrow 
Press, 1969* 

Hirsch, Rudolph. "Evaluation of Book Collections." in Library 

Evaluation , pp. 7-20. Edited by Wayne S. Yenawine. Syra- 
cuse, N.Y.: Syracuse University Press, 1959* 

Lyle, Guy R. The Administration o f the College Library . . 3d ed. 
New Yorki H.W. Wilson, I96I. 

Raney, M. Llewellyn. The University Libraries . Chicago, HJj^*? 

University of Chicago Press, 1939* ' 

Tauber, Maurice F.; Cook, C.Donald; and Logsden, Richard H. 

The Columbia University Libraries. A Report on Present and 
Future Needs Prepared for the President's Committee on the 
Future of the University . New York: Columbia University 
Press, 1958. 

V/illiams, Edwin E. "Surveying Library Collections." In Library 
Surveys , pp. 23-'*5» Edited by Maurice F. Tauber and 
Irlcne R. Stephens. New York: Columbia University 
Press, 1967. 

Wilson, Louis R. and Tauber, Maurice F. The University Library . 

The Organizati o nt Administration, and Functions of Academic 
Libraries . 2d ed . New York: Columbia University Press, 
195s: 



Periodicals 

"A.L.A. Standards for College Libraries." College and Research 
Libraries 20 (July 1959): 27^-80. 

Bach, Harry. "Evaluation of the University Library Collection." 

Library Resources and Technical Services 2 (Winter 1958): 
24-9. 



60 



SI 



BEST COPY AVAILABLE 



Beck, Richard J. "Evaluation of the Holdinf?8 in Science and 

Technology in the University uf Idaho LdbraryJ* Bookmark 
11 Supplement (June 1959): 1-24 ♦ 

Bonn, George S» "Evaluation of the Collection •" Library Trends 
- 22 (January 197^): 265-304. 

Brown, Helen M» "The Standards and the College Library in 1965*" 
Drexel Library Qu arterly 2 (July 1966): 202-6 • 

Cassata, Mpry and Dewey, Gene L. "The Evaluation of a University 
Library Collections Some Guidelines," Library Resources 
and Technical Services 13 (Fall 1969): 450-7r 

Clapp, Verner and Jordan, Robert "Quantitative Criteria 
for Adequacy of Academic Library Collections«" College 
and Research Libraries 26 (September 1965)5 371-82 • 

David, Charles "On the Survey of a Research Library by 

Scholars," College and Research Libraries 15 (July 1954); 
290-1* 

Gelfand, Morris A, "Techniques of Library Evaluators in the 
Middle States Association." College and Rgs^^^.^i^i,, 
19 (July 1958): 305-20, 

Hendricks, Donald D. "Standards for College Libraries," Texas 
Library Journal 48 (May 1972): 74-6, 

Kebabian, Paul B, "The Distance to a Star: Subject Measurement ^.^ 
of the Library of Congress and University of Florida 
Collections « " College and Re searcli Libraries 27 
(July 1966): 267-70. ———^ ^ 

Mclnnis, R. Marvin. "Research Collections: An Approach to the 
Assessment of Quality." IPLO Quarterly I3 (July 1971): 
13-22 • 

Ottersen, Signe (comp.) "A Bibliography on Standards for Evaluat- 
ing Libraries." College and Researc h Li braries 32 
(March 1971): ' — « 

Stayner, Marcia S. "A Creative Approach to Collection Evaluatione" 
IPL O Quarterly I3 (July 1971): 23-8. 

Steig, Lewis F. "A Technique for Evaluating the College Library 
Book Collection." Library Quarterly 13 (January 1943): 
34-44. 

Stone, Elizabeth 0. "Measuring the College Book Collection." 
Library Journal 66 (November 1941): 94l«3, 



1 



/I 



62 COPY mmmii 



Webb, William. "Project CoED; A University Library Golleetion 
Evaluation and Development Program," Library Resouroee 
and Technical Services 13 (Fall 1969)T^*F7-o2 . 

Webbert, Charles A. "Evaluation of the Holdings in Social Science 
in the University of Idaho Library." Bookmark 1^ Supple- 
ment (March 1962): ii, 1-18. 



Miscell aneous Sources 

Burn©, R. Wo Eva luation of the Holdings in Science and Technolo gy 
in the University of Idaho Library ^ Bethesda, Md. : ERIC 
Document Reproduction Service, ED 021 579* 1968. 

Covey, Alan D, "Evaluation of College Libraries for Accredita- 
tion Purposes." Ph.D. diBsertation, Stanford University, 
1955. 

MacKeigan, Helaine, (comp.) American Library Directory. A Clasa - 
ified List of Libraries in the United States and Canada 
with Personne} and Statistical Data. 1972-73 . 28th ed. 
New York: R. R. Bowker Company, 1972. 

U.S. Department of Health, Education and Welfare. Office of 

Education. National Center for Educational Statistics. 
Education Directory 1969-70 . Higher Education . Washing- 
ton, D.C.: Government Printing Office, 1970. 

U.S. Department of Health, Education and Welfare. Office of 
Education. National Center for Educational Statistics. 
Library Statistics of Colleges and Universities . Institu - 
tional Data. Parts A and B. Fall, 1971. Washington, 
D.C.: Government Printing Office, 1972. 



ERIC 



G8 



